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Linear Transceiver Design for a MIMO Interfering Broadcast Channel Achieving 

Max-Min Fairness 

Meisam Razaviyayn, Mingyi Hong, and Zhi-Quan Luo 

Abstract 

We consider the problem of linear transceiver design to achieve max-min fairness in a downlink MIMO 
multicell network. This problem can be formulated as maximizing the minimum rate among all the users in an 
interfering broadcast channel (IBC). In this paper we show that when the number of antennas is at least two at 



^ _ each of the transmitters and the receivers, the min rate maximization problem is NP-hard in the number of users. 

<^ Moreover, we develop a low-complexity algorithm for this problem by iteratively solving a sequence of convex 

subproblems, and establish its global convergence to a stationary point of the original minimum rate maximization 
problem. Numerical simulations show that this algorithm is efficient in achieving fairness among all the users. 

I. Introduction 

We consider the linear transceiver design problem in a MIMO-IBC, in which a set of Base Stations 
(BSs) send data to their intended users. Both the BSs and the users are equipped with multiple antennas, 

■ an d they share the same time/frequency resource for transmission. The objective is to maximize the 
^ ■ minimum rate among all the users in the network, in order to achieve network-wide fairness. 

■ Providing max-min fairness has long been considered as an important design criterion for wireless 
\q • networks. Hence various algorithms that optimize the min-rate utility in different network settings have 

been proposed in the literature. References ll20ll . ETI are early works that studied the max-min signal 
^ ; to interference plus noise ratio (SINR) power control problem and a related SINR feasibility problem 



in a scalar interference channel (IC). It was shown in 112011 . [12111 that for randomly generated scalar 
, ^ \ ICs, with probability one there exists a unique optimal solution to the max-min problem. The proposed 
algorithm with an additional binary search can be used to solve the max-min fairness problem efficiently. 
Recently reference tfTTl derived a set of algorithms based on nonlinear Perron-Frobenius theory for the 



same network setting. Differently from 11201 . 112111 . the proposed algorithms can also deal with individual 
users' power constraints. 

Apart from the scalar IC case, there have been many published results 0], 0, [ffl, (HI, [fl4ll . lfT8l . 
[[T9l on the min rate maximization problem in a multiple input single output (MISO) network, in which 
the BSs are equipped with multiple antennas and the users are only equipped with a single antenna. 
Reference [[191 utilized the nonnegnative matrix theory to study the related power control problem when 
the beamformers are known and fixed. When optimizing the transmit power and the beamformers jointly, 

M. Razaviyayn, M. Hong, and Z.-Q. Luo are with the Department of Electrical and Computer Engineering University of Minnesota, 
Minneapolis, MN 55455, USA 

This research is supported in part by a research gift from Huawei Technologies Inc, and by the Army Research Office, grant number 
W911NF-09- 1-0279. 



2 



the corresponding min-rate utility maximization problem is non-convex. Despite the lack of convexity, 
the authors of HI showed that a semidefinite relaxation is tight for this problem, and the optimal solution 
can be constructed from the solution to a reformulated semidefinite program. Furthermore, the authors 
of lfT8l showed that this max-min problem can be solved by a sequence of second order cone programs 
(SOCP). Reference 03J identified an interesting uplink downlink duality property, in which the downlink 
min-rate maximization problem can be solved by alternating between a downlink power update and a 
uplink receiver update. In a related work [3], the authors made an interesting observation that in a single 
cell MISO network, the global optimum of this problem can be obtained by solving a (simpler) weighted 
sum inverse SINR problem with a set of appropriately chosen weights. However, this observation is only 
true when the receiver noise is negligible. The authors of [4] extended their early results ifTTl to the 
MISO setting with a single BS and multiple users. A fixed-point algorithm that alternates between power 
update and beamformer updates was proposed, and the nonlinear Perron-Frobenius theory was applied 
to prove the convergence of the algorithm. 

Unlike the MISO case, the existing work on the max-min problem for MIMO networks is rather 
limited; see fl4) and J9]|. Both of these studies consider a MIMO network in which a single stream is 
transmitted for each user. In particular, the author of flU showed that finding the global optimal solution 
for this problem is intractable (NP-hard) when the number of antennas at each transmitter/receiver is at 
least three. They then proposed an efficient algorithm that alternates between updating the transmit and 
the receive beamformers to find a local optimal solution. The key observation is that when the users' 
receive beamformers are fixed, finding the set of optimal transmit beamformers can be again reduced to 
a sequence of SOCP and solved efficiently. For more discussion of the max-min and its related resource 
allocation problems in interfering wireless networks, we refer the readers to a recent survey 0. 

In this paper, we consider a MIMO interfering broadcast network whereby there are multiple users 
associated with each BS, and all the users and the BSs are equipped with multiple antennas. Such a 
setting is more general than those studied in all the works cited above. Moreover, we do not restrict the 
number of transmitted data streams for each user. Recent works that deal with linear transceiver design 
in this type of network include Q, lfT6ll . However, these works aim at optimizing differentiable system 
utilities such as the weighted sum rate (WSR) utility that excludes the min-rate utility considered in this 
work. To the best of our knowledge, there is no known algorithm that can effectively compute a high 
quality solution for the max-min problem in the general context considered in this work. 

The main contributions of this paper are summarized as follows. First, we show that in the considered 
general setting, when there are at least two antennas at each transmitters and the receivers, the min-rate 
maximization problem is NP-hard in the number of users. This result is a generalization of that presented 
in 10, in which the NP-hardness results require more than three antennas at the users and BSs. We further 
provide a reformulation of the original max-min problem by generalizing the framework developed in 
|[T6l . and design an algorithm that computes an approximate solution to the max-min problem. The 
proposed algorithm has the following desirable features: i) it is computationally efficient, as in each step 
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a convex optimization problem whose solution can be obtained easily in a closed form; ii) it is guaranteed 
to converge to a stationary solution of the original problem. 

The rest of the paper is organized as follows. In Section HH we provide the system model. In Section Hill 
we give detailed analysis of the complexity of the considered problem. In Section HVT-TVl we reformulate 
the problem into an equivalent form, and propose an algorithm that iteratively optimizes the transformed 
problem. In Section [VH numerical experiments are provided. 

Notations: For a symmetric matrix X, X >z signifies that X is positive semi-definite. We use Tr(X), 
|X| and X H to denote the trace, determinant and hermitian of a matrix, respectively. We use M AfxM 
and C NxM to denote the set of real and complex N x M matrices. We use the notation j to denote the 
imaginary unit, with j 2 = — 1. We use the expression: 0<a_L6>0to indicate a > 0, b > 0, a x b = 0. 

II. System Model and Problem Formulation 

Consider a cellular network with K cells. Let us assume that the cell assignment of the users has been 
done and each BS is interested in serving the users in its own cell. More precisely, we assume each BS k, 
k = 1,2, . . . , K, is equipped with M k transmit antennas and serves I k number of users in cell k. Let us 
use the notation i k to denote the i-th user in cell k and N ik to denote the number of receive antennas of 
user i k . Also define X and Z k to be the set of all users and the set of users in cell k, respectively: 

T={i k \l<k<K,l<i< 4} , l k = {i k | 1 < i < 4} . 

Let K to be the set of all BSs /C = {1, 2, . . . , K} . Throughout, we use i, m to denote the index for the 
users, and use k,£ to denote the index for the BSs. 

For the standard linear channel model, the received signal of user i k can be written as 

h K I] 

Yi k = H ifefc x if= + 2J H ifcfc x rof! + ^2 ^2 H " {X '"« + n *fc ' 

desired signal ^ . ^ , 

intracell interference intercell interference plus noise 

where x ifc G C A/feXl and y ik G C 7Vi fe xl are respectively the transmitted and received signal of user i k . The 
matrix H ifcJ G C Ni >= xM j represents the channel response from transmitter j to receiver i k , while n ife G 
C Ni k xl denotes the complex additive white Gaussian noise with distribution CJ\f(0, crfl) at receiver i k . 

For practical considerations, we focus on optimal linear transmit and receive strategies that can 
maximize a system utility. Specifically, let BS k use a beamforming matrix V ik to send the signal 
vector s ifc to receiver i k , and suppose receiver i k estimates the transmitted data vector s ik by using a 
linear beamforming matrix U ik , i.e., 

x ife = V ik s ik , s ik = Ujy ifc , V i k G X, 

where the data vector s ik G C d 'fc xl is normalized so that E[s ifc s^] = I, and s ik is the estimate of s, fe 
at i-th receiver in cell k. V ifc G C MfcXdi fc and U ik G C Ni k xdi k are respectively the transmit and receive 
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beamforming matrices used for serving the i-th user in cell k. Let Q ik E R M *; xM * ) Q ik = V ifc V^, denote 

the transmit covariance matrix for user i k . Let V = {Vi k }i k ex and Q = {Q ife } ifee x. 
The mean squared error (MSE) matrix for user i k can be written as 



= (I - \jf k K ikk V ik )(I - vf k n tkk v lk f 



(1) 



Treating interference as noise, the rate of the i-th user in cell k is given by 

R lk = logdet (l + H ikk V ik V*H? kk (of J. + £ H w V m< V* H& ) ) (2) 



= logdet (l + II, , Q, Tl " , (all + H, v Q m ,H&) ) . (3) 

We will occasionally use the notations R ik (V) (resp. R ik (Q)) to make their dependencies on V (resp. 
Q) explicit. 

The problem of interest is to find the transmit beamformers V = {Vi k }i k <=x such that a utility of the 
system is maximized, while each BS k's power budget of the form Yll=i Tr(Vj fc V^) < P k is satisfied. 
Note that P k denotes the power budget of transmitter k. In this work, our focus is on the max-min utility 
function, i.e., we are interested in solving the following problem 

max min Ri. (V) 

{v Ifc } Ifc£X i„ex 

h (P) 
s.t. £>(V'* V £) <P k , Vfce/C. 

Similar to lfT8ll . one can solve © by solving a series of problems of the following type for different 
values of 7: 

min ££Tr(V lfc V5 

* v, k<'k ex fe=ii=i 

s.t. i? u _(V)> 7 , Vi t £l (4) 

^Tr(V lfc V«) <P k , Vfce/C. 
i=i 

The above problem is to minimize the total power consumption in the network subject to quality of 
service (QoS) constraints. In what follows, we first study the complexity status of problem © and ©. 
Then, we propose an efficient algorithm for designing the beamformers based on the maximization of 
the worst user performance in the system. 



5 



III. NP-Hardness of Optimal Beamformer Design 

In this section, we analyze the complexity status of problem © and ©. In the single input single 
output (SISO) case where M k = N ik = 1,V k E /C,V i k G X, it has been shown that problem © and 
problem © can be solved in polynomial time, see ifTOl and the references therein. Furthermore, it is 
shown that in the multiple input single output (MISO) case where M k > N ik — 1, V k E K,, V i k E I, 
both problems are still polynomial time solvable JT), |fl2|. In this section, we consider the MIMO case 
where M k > 2, and N ik > 2. We show that unlike the above mentioned special cases, both problems © 
and © are NP-hard. 

In fact, it is sufficient to show that for a simpler MIMO IC network with K transceiver pairs and with 
each node equipped with at least two antennas, solving the max-min problem (P) and the min-power 
problem © are both NP-hard. For convenience, we rewrite the max-min beamformer design problem in 
this K user MIMO IC as an equivalent covariance maximization form 



max A 

(A,Q) 



s.t. \<R k (Q), Tr(Q fc ) < l,Q fc ^ 0, V k = 1, 



(5) 



K. 



where R k (Q) = log det + H fefe Q fc H^(o-|I + J2j^k H JyQj H jy) -1 ) • Note that ^ is the slack variable 
that is introduced to represent the objective value of the problem. The first step towards proving the 
desired complexity result is to recognize certain special structures in the optimal solutions of the problem 
©. 

Let us consider a 3-user MIMO IC with two antennas at each node. Suppose — \ for all k and the 
channels are given as 



H; 



1 
1 



Vi = 1,2,3 and H, 



2 
2 



V i 7^ m, i, m = 1, 2, 3. 

Our first result characterizes the global optimal solutions for problem ([5]) in this special network. 



(6) 



Lemma 1 Suppose K = 3 and the channels are given as ©. Let S = {(A*, Q^, Q2, Q3)} denote the 
set of optimal solutions of the problem ©. Then S can be expressed as 



s = {(1, q:, q:, q*), a, qiqi Q&). (1. q:, q:, q:), a, qs, qs)> , 



(7) 



where Q* 



1 









0.5 0.5j 


, and = 


0.5 


-0.5j ' 





1 


-0.5j 0.5 


_ 0.5j 


0.5 



The proof of this lemma can be found in the Appendix A. Next we proceed to consider a 5-user 
interference channel with two antennas at each node. Again suppose a 2 = 1 and the channels are given 

'The equivalence is in the sense that for every optimal solution {V*} of (P) with Mk = dk, there exists A* > so that by defining 
Q£ = V£Vj* H ,V k, the point {A*,Q*} is an optimal solution of l[5}- Conversely, if {A*,Q*} is an optimal solution of l[5) and Q£ = 
V£V£ H ,Vfc, then V* is an optimal solution of (P). 



6 



H, 



1 
1 

2 




, Vi= 1,2,3 and H t 



,Vi = 4,5, H 4 



1 3 




2 
2 



V i 7^ m, i, m = 1, 2, 3; 



(8) 



,Vm = l,2,3, H 



5m 



H^ m = 0, V i = 1, 2, 3, V 777, = 4, 5; H^ m = 0, V i ^ m, z, 777, = 4, 5. 



j 1 




,Vm = l,2,3; (9) 
(10) 



Our next result characterizes the global optimal solutions for the problem © for this special case. 

Lemma 2 Suppose K = 5 and the channels are given as (|8T)-([T01). Let Q*, Z>e defined in Lemma\T} 
Denote the set of optimal solutions of the problem © as T. Then T can be expressed as 



t = {(i, q:, q:, q:, q:, q:), (i, qi qi, qi, qi, am . 



(id 



Proof: First of all, it is not hard to see that by selecting each of the values in the optimal set T, we 
get the objective value of A* = 1. Therefore, it suffices to show that for any other feasible point, we get 
lower objective value. To show this, we first notice that the first three users form an interference channel 
which is exactly the same as the one in Lemma \T\ Therefore, in order to get the minimum rate of one, 
we need to use one of the optimal solutions in S in Lemma [T] for (Q 1; Q 2 , Q3). Furthermore, it is not 
hard to see that using either (Qi, Q 2 , Q 3 ) = (Q*, Q* c , Q* c ) or (Qi, Q 2 , Q3) = (Q* d , Q* d i Q*d) would cause 
high interference to either user 4 or user 5 and prevent them from achieving the communication rate of 
one. Therefore, the only optimal solutions are the ones in the set T. ■ 
Using Lemma [2l we can discretize the variables in the max-min problem and use it to prove the 
NP-hardness of the problem. In fact, for any 5 users similar to the ones in Lemma [2l there are only two 
possible strategies that can maximize the minimum rate of communication: either we should transmit on 
the first antenna or transmit on the second antenna. This observation will be crucial in establishing our 
NP-hardness result. 

Theorem 1 For a K-cell MIMO interference channel where each transmit/receive node is equipped with 
at least two antennas, the problem of designing covariance matrices to achieve max-min fairness is 
NP-hard in K. More specifically, solving the following problem is NP-hard 



max 
{Qi}fii 

s.t. 



mm 

k 



logdet I + H fcfc Q fc Hf fc (o£l + HjyQiHg) 
Tr(Q fe )<P fe ,Q fc ^0, k = !,-■■ ,K. 



(12) 



This theorem is proved based on a polynomial time reduction from the 3-satisfiability (3-SAT) problem 
which is known to be NP-complete (6]|. The 3-SAT problem is described as follows. Given M disjunctive 
clauses ci, • ■ ■ , c M defined on Boolean variables Xi ■ ■ ■ , x N , i.e., c m = y m i V y m2 V y m3 with y mi e 
{xi, • ■ ■ , xn, xi, - ■ ■ , xn}, the problem is to check whether there exists a truth assignment for the Boolean 
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variables such that all the clauses are satisfied simultaneously. The details of the proof of the theorem 
can be found in Appendix B. 

Corollary 1 Under the same set up as in Theorem [7] problem © is NP-hard. 

To see why the above corollary holds, we assume the contrary. Then a binary search procedure for 
A would imply a polynomial time algorithm for (P), which would contradict the NP-hardness result of 
Theorem [TJ 

IV. The Max-Min Problem and Its Equivalent Reformulation 

The complexity results established in the previous section suggests that it is generally not possible to 
solve the max-min problem © to its global optimality in a time that grows polynomially in K. Guided by 
this insight, we reset our goal to that of designing computationally efficient algorithms that can compute 
a high quality solution for (P). To this end, we first provide an equivalent reformulation of problem dPj), 
which will be used later for our algorithm design. 

Introducing a slack variable A, the problem © can be equivalently written as 

max A (PI) 

{V lfc } Ifcex ,A 

s.t. Ri k (V) > \,Vi k el 

E "^Vg] < ft, Vfce/C. 

In order to further simplify the problem, we need to introduce the following lemma. 
Lemma 3 The rate of user i k in © can also be represented as 

R lk = ma* logdet (WJ - Tr (W ik E ik ) + d ik , (13) 
Ui k ,w ifc 

where E ifc is the MSE value of user i k given by ©. 

Proof: First, by checking the first order optimality condition of (fT3l with respect to U ifc , we get 

wf k {3 lk v* k ^u lkk v lk ) = o ui=j^n lkk v lk , 

where 3 ik = afl + ^.^H^V^.V^H^ and U* fe is the optimal solution of (fT3T) . By plugging in the 
optimal value U* fe in ®, we obtain E°f = I - Vf k H? k Jr 1 B. ihk V ik . Hence plugging E°f in O yields 

max log det (W lk ) - Tr (W lk E Ife ) + d lk 
u **. w ** 

= max logdet(W 4 J-Tr(W u E°f)+d lfc . (14) 
The first order optimality condition of (fl4)) with respect to W ife implies W* = (E^f*) 1 . 



By plugging in the optimal W* in (fl4l) . we can write 

max log det ( W, J - Tr (W ik E ik ) + d i: 
= -logdet(E°f) 



- logdct (I - H lkk V lk V^H^J- 1 ) 
logdct f 3 lk (3 ik - H,,vV\. v,'X',; 



which is the rate of user i k in ©. 
Using the observation in Lemma [H we consider the following reformulated problem of © 



min maxTr[W 4fc E lf J - log det (W, J - d ik (Q) 
u,v,w i k ei 



s.t. ]T Tr I v ^ v ^] < ft, V fc e /C. 



Again introducing the slack variable A, the above problem is equivalent to 

max A (Ql) 

V,U,W,A 

s.t. Tr[W ife E ife ] - logdct(W l J - d lk < -A, V i k e 2 
E T ^ k V? k ] < P ^ VkelC. 

ik£lk 

In the above formulation, we have introduced the weight matrix variables W ife G xdl k and the receive 
beamformer variables Uj fc E C dl k xNi k i % k e X. Note that for fixed receive and transmit beamformers, the 
MSE matrix for user %\. is a function of V = {Vi k }i k ex and U ik , and is defined in (0Q). In the following 
analysis, E ife (XJ ik , V) will be occasionally used to make the dependency of the MSE matrix on the 
transmit/recieve beamformers explicit. For notational simplicity, we further define W = {W ife }j feG i and 
U 4 {XJ ik } ik£l . The feasible set of beamformers of BS k is V k 4 {{V ik } lk&Xk : J2 ie x k Tr[V ifc Vg] < P k }; 
Define the feasible set for V as V = ELe/c^- 

At this point, the precise relationship of the problems (PI) and (Ql) (or their equivalent problems 
(P) and (Q)) is still not clear. In the following, we provide a series of results that reveal an intrinsic 
equivalence relationship of these two problems. 

To proceed, the following definitions are needed. The minimum mean squared error (MMSE) receiver 
for user i k is defined as 



t -rmmsc 

ik 



(E E Hfc/V^V^H^ + afl] Tl ,V, 4 $ <jb (v). (15) 



When the MMSE receiver is used, the corresponding MSE matrix E™ msc (which is a function of V) is 
given by 

E— (V) = I - VjHj jfe U— y 0. (16) 
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Define the inverse of the MSE matrix as 

T ifc (V)^(E™(V))"V0. (17) 

Let vf(V) 4 {%(V)k 6 z and T(V) 4 {T ife (V)} 4eZ . 

Our next result shows that there is a connection between the stationary solutions (or every KKT point) 
of problem (PI) and the stationary solutions of problem (Ql). Moreover, the same connection holds for 
the global optimal solutions of the two problems. 

Proposition 1 Let (A*,V*) be an arbitrary KKT point of problem (PI). Then (A*, V*, U*, W*) = 
(A*, V*, (V*), T(V*)) is a KKT point of (Ql). Conversely, suppose (A*, V*, (V*), T(V*)) is a KKT 
point of problem (Ql), then (A*, V*) must be a KKT point of problem (PI). Moreover, the triple 
(V*,U*, W*) = (V*,*(V*),T(V*)) is a global optimal solution of problem (Ql) if and only ifV* is 
a global optimal solution of problem (PI). 

The proof of Proposition Q] is rather involved and thus relegated to the Appendix C. 

V. The Proposed Algorithm 

In this section, we utilize the above equivalence relationship to design a simple algorithm for problem 
(PI). Our strategy is to compute a stationary solution of problem (Ql) instead. 

We propose to update the variables U, V, and W alternately. More specifically, let us use n as the 
iteration index. Then the proposed algorithm alternates among the following three steps 

V n+1 g $(U n , W n ), U n+1 = W(V n+1 ) 3 W n+1 = T(V n+1 ) 
where and T(-) are respectively given in (fl"5l) and (flTI) . The mapping $(•) is defined as 

V G $(U, W) V G argminmaxTr[W ifc E;J - logdet(W ife ) - d ik . 

In words, every element in the range of the map $(W, U) is an optimal solution to the problem 

minmaxTr[W ijk E ijk ] - logdet(Wj - d ih (Q-V) 
s.t. V G V. 

In the following, we will proceed to obtain the solution to the problem (Q-V). Introducing a slack 
variable 7, the problem (Q-V) can be equivalently written as 

min 7 

V,7 

s.t. Tr[W lfc E lfc ] - logdet(W ife ) - d ik < 7, Vi fc Gl 
V G V. 
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Utilizing the definition of the MSE matrix in ©, we can see that this problem is a convex problem, as the 
objective is linear, and all the constraints are convex (in fact, quadratic). Thus, this problem can be solved 
in a centralized way using conventional optimization package. The overall algorithm is summarized in 
Table H 

Theorem 2 The iterates generated by the alternating algorithm given in Table d converge to the set of 
KKT solutions of the problem (PI). In other words, 

lim d(V n , S) = 

n—^oo 

where S is the set of KKT points of (PI) and d(V,S) = infues II V — U||. 

Proof: Let us define the value of the objective function of problem (Q) as G(V, U,W). Due to 
equivalence, G(V,U, W) can also represent the value of the objective function of problem (Ql). First, 
we observe that the sequence {G(V n , U n , W n )}^L 1 monotonically decreases and converges. Denote its 
limit as G. Due to the compactness of the set V, the iterates {V"}" =1 must have a cluster point V. Let 
jyntjoo^ k e subsequence converging to V. Since the maps T(-) and are continuous, we must 
have 

lim (V n %U nt ,W nt ) = (V,U,W) = (V,W(V),T(V)) 

t— >oo 

First we will show that in the limit we have: V G $(W,U). Due to the optimality of V nt+1 and 
monotonic decrease of the objective function, we have that 

G(V nt+1 ,U nt+1 ,W n * +1 ) < G(V nt+1 ,U nt , W nt ) < G(V,U nt ,W nt ), V V G V, V n t . 

Taking the limit of both sides, we have tha1§| 

G = G(V, U, W) < G(V, U, W), VVeV. 

Consequently, we must have V G $(W, U). 

The next step is to establish that (V,U, W) = (V, \P(V), T(V)) is a KKT solution of (Ql). Firstly, 
the fact that V G $(W, U) implies that V is a global optimal solution of the following convex problem 

min A 

V,A 

s.t. Tr[W ifc E ifc (U ifc , V)] - logdet(WiJ - d ik < A, V i k G X 
V G V. 

Consequently (V,A) must satisfy the following optimality conditions (where /2, e are the associated 

2 Note that taking the limit inside the objective value G(-) is legitimate, as the objective function of problem |Qj is continuous (albeit 
nonsmooth). 
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Lagrangian multipliers) 

- E W*W m< (Tr[W ifc E ifc (U ifc , V)]) - 2e 3 V tj = 0,V m t 6l 

E = 1 

0</2 ifc ±-Ti[W 4fc ECU ifc ,V) ifc ] + bgdet(WiJ + di fc -A>0,VifceJ 

< e fc J_ P fe - E TrIVi.Vg] > 0, V fc G /C. 

Similarly, using the fact that U = \P(V) and W = T(V), we have that U and W must satisfy 

Vu, k (Tr[W lfc E ik (U Jfe , V)]) = 0, V i k e 1 
V Wifc (Tr[W ifc E ife (U ife , V)] - Iogdet(W ifc )) = 0, V i k e 1 

which in turn implies that the following conditions are true 

-/^V^ (Tr[W, fe E Jfe (U, fc , V)]) = 0, V i k G X 
-^V Wll (Tr[W, fc E, fc (U lfc , V)] - logdet(W 4 J) = 0, V i k G X. 

In conclusion, we have that (V, U, W) = (V, ^(V), T(V)) along with the slack variable A and the 
multipliers (p>,e) satisfy the KKT condition for problem (Ql) (as expressed in (I30l)-d35l) in the Appendix 
C). This result implies that (V, U, W) = (V, *(V), T(V)) is a KKT solution to problem (Ql). Applying 
the result in Proposition [TJ we conclude that V must be a KKT point of the original problem (PI). 
So far we have proved that any cluster point of the iterates is a KKT point of (PI). Since the feasible 
set V is compact, we have Hindoo d(V n , S) = 0, and this completes the proof. ■ 

Several remarks regarding the above results and the existing results in lfT6l are in order. 

Remark 1: The original max-min problem © has nonsmooth objective functions. Consequently the 
proof of the equivalence relationship of problem (P) and (Q) (i.e., Proposition [Q) is very different from 
the cases presented in lfT6ll . In particular, in the reformulated problem (Ql), fixing the variable V and 
solving for variables U and W generally admits multiple solutions. This is because at optimality, it is 
possible that not all the constraints on U and W variables in (Ql) are active. For those constraints that 
are inactive, their corresponding XJ ik and W ifc can take multiple values. 

The possibility of the existence of multiple solutions for problem (Ql) when fixing V has the following 
consequence: a) The proof of the equivalence relationship of the stationary solutions becomes much 
involved (see the proof of Proposition [D; b) There is no longer an one to one relationship between 
the stationary solutions of problem (PI) and (Ql). Instead, one stationary solution of problem (PI) may 
correspond to a set of stationary solutions of problem (Ql). 

Remark 2: The proof of convergence of the alternating directions algorithm becomes more involved. 
Different from that of lfl6l . the conventional convergence analysis for the block coordinate descent (BCD) 
algorithm no longer applies in this context. This is because the proof for the conventional BCD algorithm 
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requires that at least 2 of the 3 subproblems involving block variables must have unique solutions (see, 
e.g., O), which is clearly not the case here. Furthermore, the BCD algorithm requires that the objective 
function is continuously differentiable and the constraints are separable among the block variables. 
However, in our case the constraints of problem (Ql) are coupled among different block variables . 

VI. Simulation Results 

In this section, we present some numerical experiments comparing four different approaches for the 
beamformer design in the interfering broadcast channel. The first approach for designing the beamformers 
is the simple "WMMSE" algorithm proposed in |[T6ll for maximizing the weighted sum rate of the system. 
Since the sum rate utility function is not a fair utility function among the users, we also consider the 
proportional fairness (geometric mean) utility function of the users. We use the framework in lfT6ll . lfi~3l 
for maximizing the geometric mean utility function of the system and the resulting plots are denoted by 
the label "GWMMSE". 

Another way of designing the beamformers for maximizing the performance of the worst user in the 
system is to approximate the max-min utility function. One proposed approximation for the max-min 
utility function could be (see ifTTTO : min ifc R ik « log (J2i k ei ex P(~ ^0)- Therefore instead of solving 
problem ©, we may maximize the above approximation of the objective by solving the following 
optimization problem 

max ^exp(-i? i J 

i k &X 

h (18) 
s.t. ^Tr(V, fc Vj)<P fc , Vfce/C. 

i=i 

If we restrict ourselves to the case of di k = 1 , V ik E X, then E ifc in (0Q) becomes a scalar and thus we 
can denote it by e ik . Using the relation (fT~3l) and plugging in the optimal value for the matrix W ifc yields 
R ik = log(e^ 1 ). Plugging in this relation in (fl"8~T) . we obtain the equivalent optimization form of (fl"8~T) : 

i k ei 

(19) 

s.t. ^Tr(V ifc Vj)<P fc) VA, 
i=i 

which is the well-known sum MSE minimization problem and we use the algorithm in lfl"5l to solve (fT9l) . 
The corresponding plots of this method are labeled by "MM5£"' in our figures. 

In our simulations, the first four plots are averaged over 50 channel realizations. In each channel 
realization, the channel coefficients are drawn from the zero mean unit variance i.i.d. Gaussian distribution. 

In the first numerical experiment, we consider K = 4 BSs, each equipped with M = 6 antennas. 
There are / = 3 users in each cell where each of them is equipped with N = 2 antennas. Figure Q] and 
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Figure [2] respectively represent the rate cumulative rate distribution function and the minimum rate in the 
system. The SNR level is set to 20dB in Figure [Q As these figures show, our proposed method yields 
substantially more fair rate allocation in the system. 

In our second set of numerical experiments in Figure |3] and Figure HI we explore the system with 
K = 5 cells where each BS serves 1 = 3 users. The number of transmit and receive antennas are 
respectively M = 3 and N = 2. 

Figure [5] and Figure [6] show the convergence rate of the algorithm while a user is joining the system. 
In these plots, there are 5 cells and 2 users in each cell initially and at iteration 4, another user is added 
to one of the cells. When the extra user is added to the system, the power for the users in the same 
cell is reduced by a factor of | and the rest of the power is used to serve the joined user initially. The 
precoder of the joined user is initialized randomly. Figure |5] shows the objective function of (Q) during 
the iterations while Figure [6] demonstrates the minimum rate of the users in the system versus the iteration 
number. 

Figure [7] and Figure [8] represent the performance and the convergence rate of the algorithm when the 
channel is changing during the iterations. At iteration 7, the channel is changed by a Rayleigh fade with 
power 0.1. As it can be seen from the plots, the algorithm converges fast and it adapts to the new channel 
after a few iterations. 

VII. Appendix 

A. Proof of Lemma \B 

First of all, it can be observed that choosing Qi = Q 2 = Q3 = Q* yields an objective value of 
A* = 1; the same result holds for the case of Qi = Q2 = Q3 = Q&, Qi = Q2 = Q3 = Q*> an d 
Qi = Q2 = Q3 = Qd- 

Let (A, Qi, Q2, Q3) G 5 be an optimal solution. Clearly, at least one of the users must transmit with 
full power, for otherwise we could simultaneously scale (Q l7 Q 2 , Q3) to get a better objective function. 
Without loss of generality, let us assume that user 1 is transmitting with full power, i.e., Tr(Qi) = 1. 
Using eigenvalue decomposition of Qi, we can write Qi = aaa H + (3hh H , where a and b are the 
orthonormal eigenvectors of Q x and the scalars a,/? > are the eigenvalues of Qi with a + (3 = 1. 
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Since canceling the interference results in higher rate of communication, we have 



R 2 = logdet 1 + Q 2 I + H 2m Q m Hf m 

< logdet (i + Q 2 (I + H 21 (aaa ff + pbb 11 )!!^ 1 
= logdet ( I + Q 2 fl + 4a a a H + 4/3 b b H 



= log det I + Q 2 



1 + 4a 



a a 



ii 



1 



1 + 4/3 



b b 



< log det I 



Tr(Q 2 ) Q2 V 



a a 



H 



1 



1 + 4/3 



b b 



H 



(20) 



where a = |H 2 ia and b = |H 2 ib. The last inequality is due to the fact that Tr(Q 2 ) < 1. Clearly, 



2"^" 2 

a^b = and llall = llbll = 1. 



Let us use the eigenvalue decomposition Tr ^ 2 ) = 9cc H + (1 — 6)dd H , for some 9 G [0, 1] and some 
orthonormal vectors c and d. Utilizing the fact that determinant is the product of the eigenvalues and 
trace is the sum of the eigenvalues, we can further simplify the inequality in (l20l) as 



R2 < log {1 + Tr 



log 



det 
Ox 



9cc H + (1 - 6)dd H ) 
dec" + (1 - 6)dd H 



1 



1 + 4a" 
1 



1 



1 + 4/3- 
1 



-bb 



H 



-b b 



n 



l + 4a __ 1 + 4^" 

i-x) (i-e)(i-x) (i-e)x 0(1 -e) 



< max lo 

(x,e,a,ff)ey 



l + 4a 1 + 4/3 l + 4a 1 + 4/3 (1 + 4a)(l + 4/3) _ 

6x 6(1- x) (l-6)(l-x) (l-6)x 0(1-9) 



1 



(21) 



1 + 4a 1 + 4/3 l + 4a 1 + 4/3 (1 + 4a)(l + 4/3). 

where x = |c H a| 2 , y = {(x, 9, a, f3) \ a + f3 = 1, < a, (3, x < 1}. Since the function in (12TT) is linear 
in x, it suffices to only check the boundary points x = and x = 1 in order to find the maximum. The 
claim is that the maximum in (f2TT) takes the value of 1, and it is achieved at both boundary points. 
First consider the boundary point x — 1. We have 



R 2 < max f (9, a, 8), 

(8,a,l3)eX 

where X = {(9, a, 0) \ a + 8 = 1, < a, 8} and 

9 1-9 



(22) 



f(9,a,8)±log 1 



(23) 



l + 4a 1 + 4/3 (l + 4a)(l + 4/3)_ 

We are interested in finding the set of optimal solutions of (|23T) . In particular, we want to characterize 
S L = {(9*, a*, 8*)} defined by 

S\ = arg max f(9,a,8). 

(e,a,p)ex 
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In what follows, we will prove that <Si = {(0, 1,0), (1,0, 1)}. 

First we observe that /(0, 1, 0) = /(l, 0, 1) = 1. Now, we show that f(9, a, 0) < 1, for all (9, a, ft) e X 
such that < 9 < 1. Assume the contrary that there exists an optimal point (0*, a*, /?*) such that 
< 9* < 1. Using the first order optimality condition -§jf(9*, a*,/3*) = 0, we obtain 

_ 4/3* - 4a* + 1 
2 

Combining with < < 1 yields 

-- < p* - a* < -. (24) 
4 4 

Plugging in the value of optimal 8* = 4/3 ~t, a +1 in /(•) and simplifying the equations, we obtain 

13 + 1603* - a*) 2 



Combining with (1241) yields 

14 



/(#*,«*,/?*) < log 1 + 



4(1 +4a*)(l + Aj3*) 

, ( 14 \ 
< log (H 

~ B V 4(1 + 4a* +4/3*) J 

= log(l + ^)<l J 

which contradicts the fact that max^^)^ f(9, a, /3) = 1. Therefore, the optimal 6 1 only happens at the 
boundary and we have 

{(0,l,0),(l,0,l)} = arg max f{6,a,0). 

(6,a,/3)eX 

Similarly, for the case when x = 0, we can see that the optimal solution set is {(0, 0, 1), (1, 1, 0)}. 
Using these optimal values yields i? 2 < 1 • Note that in order to have equality R 2 = 1, we must have 
Tr(Q 2 ) = 1 and 

(x,6,<x,P) e {(1,0,1,0), (1,1,0,1), (0,0,0,1), (0,1, 1,0)}. 

Let us choose the optimal solution (x, 9, a, 0) — (1, 0, 1, 0). Therefore, 

Qi = aa H , Q 2 = dd H , x = \c H a\ 2 = 1, 

which yields a^d = 0. Repeating the above argument for user 2 and user 3, we get Q 3 = gg H with 
a H g = 0. Since d and g are both orthogonal to a, we obtain d = exp j ^ d g. Repeating the above argument 
for the other pair of users yields 

a = exp J ^ a g and a H a = 0, 
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where the last relations imply that a, d, and g are the same up to the phase rotation and they belong to 
the following set (after the proper phase rotation) 

ae{[i 0]*,[0 j] H ]. 
Each of these points gives us one of the optimal covariance matrices in ©. 



B. Proof of Theorem [7] 

Proof: The proof is based on a polynomial time reduction from the 3-satisfiability (3-SAT) problem 
which is known to be NP-complete. We first consider an instance of the 3-SAT problem with n variables 
xi, x 2 , ■ ■ ■ , x n and m clauses c x , c 2 , . . . , c m . For each variable Xi, we consider 5 users Xn, X 2 %, ■ ■ ■ ■> X§i in 
our interference channel. Each user is equipped with two antennas, and the channels between the users 
are specified as in (l8l)-(fT0l). For each clause Cj, j — 1,2, ... , m, we consider one user Cj in the system 
with two antennas. In summary, we totally have 5n + m users in the system. Set the noise power a 2 = 1 
and the power budget P k = 1 for all users. We define the channel between the users Cj and Cj to be zero 
for all j 7^ %. Furthermore, we assume that the channel between the transmitter and receiver of user Ci is 
given by 

1 



H 







Let us also assume that i) there is no interference among the blocks of users that correspond to different 
variables and ii) there is no interference from the transmitter of user Cj to the receivers of users Xn, . . . , X 5i 
for all % = 1,2, ... ,n; j = 1,2, ... ,m. Consider a clause Cj : yji + yj 2 + Uj3, where yji, yj 2 , Vjz E 
{xi,x 2 , ■ . . , x n ,Xi, x 2 , ■ ■ ■ , x n } with Hi denoting the negation of Xi. We use the following rules to define 
the channels from the transmitter of user X ki to the receiver of user Cf 

If the variable x; t appears in cj, we define the channel from the transmitter of X u to the receiver of 

1 n 



If the variable appears in Cj, we define the channel from the transmitter of X Vl to the receiver of 



Cj to be 



Cj to be 



1 




• If Xi does not appear in Cj, we define the channel from the transmitter of Xu to the receiver of Cj 
to be zero. 

• The channel from transmitters of users Xn, X 3i , X&, X 5i to the receiver of user Cj is zero for all 
i = 1, . . . , n and j = 1,2, ... ,m. 

[[[As an example, draw a figure for a simple clause.]]] Now we claim that the 3-SAT problem is 
satisfiable if and only if solving the problem (fT2l) for the corresponding interference channel leads to 
the optimum value of one. To prove this fact, let us assume that the optimum value of (fT2l) is one. 
According to the Lemma [2l the only way to get the rate of one for users X k j, k — 1, . . . , 5, j — 1, . . . ,n, 
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is to transmit with full power either on the first antenna or on the second antenna. Now, based on the 
optimal solution of (fT2)) . we can determine the solution of the 3-SAT problem. In particular, if user Xu 
is transmitting on the first antenna, we set = 0. Otherwise, if it transmits on the second antenna, we 
set Xj = 1. By assigning values to all the variables in this way, we claim that all clauses are satisfied. 
We prove by contradiction. Assume the contrary that there exists a clause Cj that is not satisfied, i.e., 
all the corresponding variables are zero. Therefore, user Cj gets interference on the first receive antenna 
from all three users corresponding to the variables appearing in Cj. As the result, the interference power 
is 3. Since the noise power is one and the received signal power is 3, the SINR level for user Cj is 
which contradicts the fact that the minimum rate in the system is one. 

Now we prove the other direction. Let us assume that the 3-SAT problem is satisfiable. We claim that 
the optimal value of (fT2l) is one. Since in each block of 5 users the optimum value is one, it suffices 
to show that the objective value of one is achievable. Now, we design the covariance matrices based 
on the solution of the 3-SAT problem. If Xi = 0, we transmit with full power on the first antenna of 
users X u , X 2 i, . . . , X 5i . If Xi = 1, we allocate full power for transmission on the second antenna of 
users X u , X 2 i, . . . , X 5i . With this allocation, each user X ki , k = 1, . . . , 5, i = 1, . . . , n, gets the rate of 
one. For all users Cj, j = 1,2, ... , m, we transmit with full power on the first antenna. Since 3-SAT 
problem is satisfiable with the given boolean allocation of the variables, for each clause Cj at one of the 
corresponding variables are one. Therefore, the interference level at the receiver of user Cj is at most 2. 
Since the received signal power at the receiver of user Cj is one, the SINR level is at least = 1 which 
yields the rate of communication R Cj > 1. Thus, all users Cj,j = 1, . . . , m, have rate at least one; which 
completes the proof of our claim. As the result, checking whether the objective value of one is achievable 
for (fT2j) is equivalent to solving the instance of 3-SAT problem. Thus, problem (fT2~l) is NP-hard. ■ 

C. Proof of Proposition [7] 

Proof: The Lagrangian of problem (PI) can be expressed as 

L(V, A; M , e) = A + £ m k (R tk (V) - A) + ]T e k (P k - £ Tr[V ifc Vfj) (25) 

where = {fi ik } ik£ x and e = {e k }keic are the set of associated optimal Lagrangian multipliers. Suppose 
(A*, V*) is a KKT point of (PI), and {/i* }i h ei and {e* k }k&K are the set of associated optimal Lagrangian 
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multipliers. The KKT optimality condition for problem (PI) can be written as 

V v « . L(V* , A* ; n* , e* ) = £ tf k V Vf . Ri k (V* ) - 2e*V* e . = 0, V I, e T k (26) 



XX* = 1 ( 27 > 

< J- fli fc (V*) — A* > 0, V ifc e I (28) 
< e£ _L P fc - X Tr t V ^ ( V £. ^ 1 > 0, V fc £ /C. (29) 



Similarly, the Lagrangian of problem (Ql) can be expressed as 



L(V, U, W, A; /x, e) = A - X] fk„ (Tr[W lfc E, fc (U Jfe , V)] - logdet(W Jfc ) - d lk + A) 

+ J>(P fc - J] Tr[V ifc VjD- 

Let (V,U,W, A) be a KKT solution of problem (Ql), and let {/i ife }j fee 2 fc and be the set of 

associated optimal Lagrangian multipliers. The KKT optimality condition for problem (Ql) is as follows. 

Vv ra ,£(V,U,W, A;£,e) = - X M^V Vmf (Tr[W lfc E lfc (U lfc , V)]) - 2e,V m , = 0,V m t e I (30) 

V Uifc Z(V,U,W,A;/i,e) = -ft k Vu 1|fc (Tr[W ifc E ifc (U ifc , V)]) =0,Vi fc eI (31) 
V Wifc £(V,U,W,A;ju ) e) = -Mi fe V Wiji (Tr[W ife Ei fe (U ifc , V)] - logdet(W ife )) = 0, V i k e 1 (32) 

X = 1 < 33) 

< fo, 1 -Tr[W ifc E(Ui fe , V) ik ] + logdct(W ifc ) + d ik - A > 0, V i k e 2 (34) 

< ? k ± Pk - X Tr t^ V£] > 0, V fc 6 /C (35) 

The claim is that if V* satisfies the KKT system (|26t-(|29b, then the set of solutions (V,U, W, A) = 
(V*, (V*), T(V*), A*), {%„ e k ) = (fi* ik ,e* k ) must satisfy the KKT system (El-©. The proof for this 
claim consists of three steps. 

Step 1: It is easy to observe that condition (1331) and (1351) are satisfied. We can then verify that by 
letting U = *(V) and W = T(V), we have that 

V Uifc (Tr[W. ifc E lfc (U 4fc , V)]) = 0, V Wi , (Tr[W ifc E ifc (U ijb , V)] - logdet(Wij) = 0. 

Consequently, conditions (|3T|)-(|32l) are satisfied. 
Step 2: We then show that condition (l30l) is satisfied. 
For a set of given multipliers {fJ.* k }i k ex, define the following two index sets 

^ = {<*!/*?, = 0}; ^ = {**K >0 >- 
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In words, the set A includes the users for which the rate constraints in (PI) are active. Notice that due 

to the constraint dTTl) . set set A must be nonempty, i.e., \A\ > 0. 

According to the above defined index sets, we partition all the users' receive beamformers into two 
parts U.4 4 {U ifc }< fc0l ; U4 4 {V ik } ikeA . Define the sets W^, W^, ^(-), ^(-), T A (-), T^(-) and 
\x A and 11 A similarly. Define the reduced Lagrangian function as 

L A (V, A; //, e) = A + ]T ^ (V) - A) + £ e fc (P fc - ]T Tr[V ifc V£]) 
La(V, U, W, A; M , e) = A - £ ^ (Tr[W ifc E ifc (U ifc , V)] - logdct(W u _) - d ik + A) 

-E e *(£ Tr [Vi,v^]-p fc ) 

A key observation is that La(V, U, W, A; /x, e) is only a function of and ~W A , but not of ~U A and 
W^. Consequently, we can express it as L A (V, XJ A , W A , A; fi, e) 

Step 2.1: We show the following key identity. If U = ^(V) and W = T(V), then we have 

VvA4(V, A*; /x*, e*) = VvAa(V, TJ A , W^, A*; /z*, e*). 

Notice the fact that U ifc = ty ik (V),i k E A and W ik = T(V),i fc E A are the unique solutions to the 
following two problems, respectively 

max La(V, Ua, W a , A; fi*, e*) 
max L A (V, U4, W A , A; e*). 

This claim can be easily checked using the first order optimality conditions of the respective problems. 
We note here that the uniqueness of the solutions comes from the fact that for all ik E A, {J,* > 0, and 
the fact that W ifc and XJ ik are the unique solutions to the following problems, respectively. 

argmax-(Tr[W, fc E, fc (U lfc ,V)]) 

argmax- (Tr[W Jfe E Jfe (U ifc , V)] - logdet(W ifc )) . 



20 



Moreover, plugging U A = \&a(V) and W_4 = T^V) into L A (V, XJ A , W A , A; n*, e*), we obtain 

= A - X>i» (Tr[W,,E™(V)] - logdct(W. t J - d ih + A) + £ - £ Tr ^ V 5) 

= X-J2 ti> (** - logdet((E— (V))- 1 ) - + A) + X e ^ - £ Tr [ v ^ v ^]) 
= A + £ < (logdet((E— (V))- 1 ) - A) + X - E Tr [Vi* V ^l) 

= A+£ ^ fe (^(V)-A) + X^- E Tr[V l(i (V,J ff ]) 

where in the last equality we have used a well known relationship between the MSE matrix and the 
achievable rate: Ri k (V) = — logdet(E™ msc (V)). Consequently, we obtain 

U4 = MV), W.4 = T^(V) L A (V, U A , W A , A; fx*, e*) = L A (V, A; /x*, e*). 

Combine the above result and the uniqueness of U ifc = ^ ik (V),ik G .4 and W, ifc = T(V),i fc G *4, we 
can apply Dankin's Min-Max Theorem (See [0 Proposition B 2.5]) to obtain the desired equality 

VvMV, A*; /**, e*) = V V ^(V, U4, W^, A*; e*). (36) 

This concludes our proof of Step 2.1. 

Step 2.2: We show that condition (|26|) implies condition (|3Q|) . 

Notice the fact that for all i k G A /i* fe = 0, and the fact that Vv ifc -Ri fe (V*) takes finite value for all 
V* G V. Then condition (l26l) is equivalent to the following condition 



Vv 1 .^(V*,A;/i* ) e*) = 0,V£;Gl. (37) 
We have the following series of equalities 

V Vm( L(V* , U* , W* , A* ; (j,* , e* ) 

= - E /4 V v m , (Tr[W i; E it (Ut fe) V*)]) - 2e* e V* me 
ik ex 

= £ ^ V v m . (Tr[W* fc E ife (U* fe ,V*)]) - 2e?V^ 

i k eA 

= Vv me L A (V*,XJ*,W*,\*;(i*,e*) 
= 

where in (a) we have again used the fact that /i* = for all z fc G A, A{JA = I, and the fact that 
V Vm , (Tr[W* fc E ife (U* fe , V*)]) takes finite value for all U* = T ifc (V*), W* = * ifc (V*), and all V* G V; 
the last equality is due to (l36l) and (1371) . This shows that (|30l) is true. 
Step 3: In this step, we show that condition (1281) implies (l34l) . 
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Let V lk = %(V) and W ik = T ifc (V), we have that 

- Tr[W ifc E lfc (U lfc , V), J + log dct(W ifc ) + d ik - A 
= -Tr[W ifc E£ mB °(V)] + logdet(W ife ) + d lk - A 
= + logdet ((E^CV))- 1 ) + d lk - A 

= i^(V)-A (38) 

In d28]) we have that < fi* k _L f? ifc (V*) - A* > 0. This condition combined with ([38]) ensures d34]) is 
true for (V,U,W,A) = (V*, \P(V*), T(V*), A*). 

In conclusion, we have shown that if (V*,A*) and (/**,€*) satisfy the KKT system (f26b— (f29b. then 
(V,U,W,A) = (V*,*(V*),T(V*),A*), (j2 ik ,e k ) = (/i* fe ,e*J satisfy the KKT system @SM2U- 



We now establish the correspondence between the global optimal solutions of the two problems. The 
proof has two main steps. 

Step 1: We first argue that for every KKT solution (V*, U, W) of problem (Ql), there is a correspond- 
ing solution (V*, U*, W*) = (V*, \&(V*), T(V*)) that is also a KKT solution. Furthermore, it achieves 
the same objective value as (V*, U, W). 

Again consider the equivalent reformulation (Ql). Let (/x*,e*) denote a set of optimal multiplier 
corresponds to solution (V*, U, W, A*), that is, together they satisfy the KKT system (|3Q|)-(|35T). Define 
the index sets A and A as A = {ik\lA k = 0}j A = {ik\^* k > 0}. We will show that the solution 
(V*,U*,W*) = (V*,*(V*),T(V*)), along with the optimal slack variable A* and the multipliers 
(/a*, e*) must also satisfy the KKT system (I30l)-(l35l>. 

Firstly it is easy to see that the conditions (1351) and (l33l) are satisfied. 

We then show that the conditions (l3TI)-(l3~2l) are satisfied. Observe that for i k £ A, conditions (|3TI)-(|32|) 
imply that 

V Ulfc (Tr[W u E u (U 4fc ,V*)]) =0 
V Wlfc (Tr[W. lfc E 4fc (U lfc , V*)] - logdct(W lfc )) = 

which in turn imply that the solutions for the above problems are uniquely given as 

XJ ik = ^ fe (V*),V i k G A, W tk = T ifc (V*),V i k G A. (39) 

Thus, setting = ^^(V*) and W4 = T^(V*) ensures condition (l3~TT)-(l3"2l) for all i k G A. Alterna- 
tively, for i k G A, due to the fact that fx* = 0, the conditions (|3TI)-(|32|) is also satisfied. 

We then show that condition 00) is satisfied for solution (V*, U*, W*, A*) = (V*, #(V*), T(V*), A*). 
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This is shown by utilizing the following series of equalities similarly as in the proof of Proposition [Q 

Vv m/ 2(V*,U*,W*,A*;/x*,e*) 





-E^V Vmf (Tr[W,.E ife (U* fc ,V*)])- 

i k ei 


■ 2eJV^ 


(a) 


-E^Vv ra( (Tr[W^E ik (Ur fc ,V)])- 


- 2e|V; nf 


(6) 


- E < V v m , (Tr[W. ifc E Jt (U lfc ,V*)]) 




(c) 


V Vm( L# , ) U,W,A«;^,£*)=0 





where in (a) (resp. in (c)) we have again used the fact that /i* = for all z& £ A, = X, and 

the fact that V Vm£ (Tr[W* fc E ifc (U* fc , V*)]) takes finite value for all feasible V*, U*, W* that satisfies the 
KKT system (I30l)-(l35l): (b) is due to (l39k the last equality is due to the assumption that (V*, U, W, A*) 
together with (/x*,e*) satisfy d30l) . 

Next, it is straightforward to see that when (V*, U*, W*) = (V*, *(V*), T(V*)), then for all i k e X, 

- Tr[W; E lfc (U* fc , V* )] + log dct(W* fc ) + d lk - A* 

> -Tr[W ifc E ifc (U ifc , V* )] +logdct(W i J + di fc - A*. (40) 

This result implies that the feasibility part of (l34l) is satisfied. In order to show that the complementarity 
part of (|34|) is also satisfied, it is sufficient to show that for all ik € A (i.e., for all ik such that fi* > 0), 
(l40l) achieves strict equality. This is guaranteed by (l39l) . 

So far we have shown that (V*, U*, W*, A*) = (V*, \&(V*), T(V*), A*) along with 0*,e*) satisfy 
the KKT system (I30l)-(l35l). The last step we need to show is this solution achieves the same objective 
value as (V*,U,W). 

For this purpose, observe that due to the fact that J2i k ei k = 1> we must nave 1^1 > 0. Due to 
complementarity condition (|29l) , at least one of the constraints 

-Tr[T ih (V*)E ih (* ifc (V*), V*)] + logdet(T ifc (V*)) + d ik - A* > 

is active. This implies that min ifeeX - (Tr[T lfc (V*)E ife (*i fe ( v *)> V*)] - logdet(W*J - d ik ) = A*. Simi- 
larly, we must also have mm ik€X - (Tr[W ifc E ifc (U ifc , V*)] - logdet(W 4fc ) - d ik j = A*. 

We conclude that for every KKT solution (V*, U, W) of problem (Ql), (V*, U*, W*) = (V*, (V*), T(V*)) 
is also a KKT solution, and it achieves the same objective value as (V*,U, W). 

Step 2: Now we are ready to argue the equivalence of problem (PI) and (Ql). Let us use /(V) and 
/(V, U, W) to denote the objective value of problem (PI) and (Ql), respectively. 

Firstly, we can check by simple substitution that for any given V G V, /(V) = /(V, ^(V), T(V)). 

Suppose V*,U*,W* is a global optimal solution of problem (Ql), but V* is not a global optimal 
solution of (PI). Then there must exist a solution V such that /(V) > /(V*). From the first part of the 
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proof we have that V*, \P(V*), Y(V*) is also a KKT solution and it achieves the same objective value 
as V*,U*,W*. Consequently V*, tf(V*), T(V*) is also a global optimal solution for (Ql). Using the 
fact that /(V) = /(V, (V), T(V)), we conclude that 

/(V*, *(V*), T(V*)) = /(V*) < /(V) = /(V, (V), T(V)) (41) 

However this contradicts the global optimality of the solution V*, \&(V*), T(V*) for problem (Ql). 
The reverse direction can be argued similarly. ■ 
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TABLE I 

PSEUDO CODE OF THE PROPOSED ALGORITHM 



1 


Set n = 0. Initialize V°,U°, and W° 




ranaomiy sucn mar me power uucigei 




constraints are satisfied. 


2 


repeat 


3 


V n+1 G $(U n ,W n ) 


4 


Tjn+l _ \J/(V n+1 ) 


5 


W n+1 = T(V n+1 ) 


6 


n <— n + 1 


7 


until some convergence criterion is met 




Fig. 1. Rate CDF: K = 4, 1 = 3, M = 6, N = 2, d = 1 
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Fig. 2. Minimum rate in the system versus SNR: K = 4, 1 = 3, M = 6, N = 2, d = 1 
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Fig. 3. Rate CDF: K = 5,I = 3,M = 3,N = 2,d=l 



27 



0.7 




0.1 - 



rjl 1 1 1 1 1 

5 10 15 20 25 

SNR(dB) 



Fig. 4. Minimum rate in the system versus SNR: K = 5, 1 = 3, M = 3, N = 2, d = 1 
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Fig. 5. WMMSE objective function while adding a User: K = 5, M = 3, N = 2, ri = 1 




Fig. 7. WMMSE objective function while changing the channel: K = 5, / = 2, M = 3, N — 2, d — 1 
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Iteration Number 

Fig. 8. Minimum rate while changing the channel: K = 5, / = 2, M = 3, N — 2, d = 1 



